The code is based on mainly on gym==0.19.0, mujoco-py==1.50.1.0 and tensorflow==1.9.0.